Free randomness amplification using bipartite chain correlations 



m 

O 
(N 



(N 
(N 



Andrzcj Grudka.^ Karol Horodecki,^''^ Michal Horodccki,^"'* Pawel 
Horodccki,^'^ Marcin Pawlowski,^'^ and Ravishankar Ramanathan^ 

^Faculty of Physics, Adam Mickiewicz University, 61-614 Poznan, Poland 
''National Quantum Information Center of Gdansk, 81-824 Sopot, Poland 
'^Institute of Informatics, University of Gdansk, 80-952 Gdansk, Poland 
'^Institute of Theoretical Physics and Astrophysics, University of Gdansk, 80-952 Gdansk, Poland 
^Faculty of Applied Physics and Mathematics, Technical University of Gdansk, 80-233 Gdansk, Poland 
^Department of Mathematics, University of Bristol, Bristol BS8 ITW, U.K. 
(Dated: March 25, 2013) 

A direct analysis of the protocol of randomness amplification using Bell inequality violation is 
performed in terms of the convex combination of no-signaling boxes required to simulate quantum 
violation of the inequality. The probability distributions of bits generated by a Santha-Vazirani 
source are shown to be mixtures of permutations of Bernoulli distributions with parameter defined 
by the source. An intuitive proof is provided for the range of partial randomness from which perfect 
randomness can be extracted using quantum correlations violating the chain inequalities. Exact 
values are derived in the asymptotic limit of a large number of measurement settings. 
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Introduction. The question whether all processes in 
Nature are predetermined or if there are fundamentally 
unpredictable events is a most fundamental one. While it 
seems impossible to rule out complete determinism at all 
levels, the philosophical and practical implications such 
as in gambling and cryptographic scenarios have made 
it a question worthy of thorough investigation. In this 
regard, exciting new results have been obtained in [H-Q 
that the correlations in quantum systems can be used to 
amplify randomness. In particular, it has been shown 
that the presence of a small amount of unpredictability 
can be used to infer the presence of truly random events. 

Formally, the information-theoretic task is called ran- 
domness amplification, where the goal is to use an input 
source of partially random bits to produce a perfect ran- 
dom bit. The source of randomness is taken to be the 
Santha-Vazirani source [3| which is defined as follows. A 
source is called a Santha-Vazirani (SV) source if for any 
random variable X = {Xi, X2, . . . , Xn) produced by this 
source and for any < i < n and Xi ~ {0, 1}, there holds 



e < P{Xi+i = Xi+i\Xi 



■ ■,X, 



Xi 



< 



1 



(1) 

The model can be interpreted as each bit being obtained 
by the fiip of a biased coin, the bias being fixed by an ad- 
versary who has knowledge of the history of the process. 
As such, the conditioning variables can be any set of pre- 
existing variables W that could be a possible cause of the 
succeeding bit Xi^i. Each bit produced by the source is 
e-free in the sense that the probability distribution is e 
away in variational distance from the uniform distribu- 
tion. The goal of randomness amplification is to produce 
perfect random bits, i.e., those with enew = 0. Note that 
randomness amplification differs from the task of (device- 



independent) randomness expansion, where it is assumed 
that an input seed of perfect random bits is available and 
the goal is to expand this given bit string into a larger 
sequence of random bits. Quantum non-locality has also 
found application in this latter task [Hl-Q as well as in 
device- independent cryptographic scenarios [J Q . 

In it was shown that the randomness produced 
by a single SV source cannot be amplified by classical 
means, by any deterministic function. The idea behind 
randomness amplification using quantum correlations in 
[H 01 is then to use the SV source to choose the measure- 
ment settings of a set of spatially separated observers in 
a Bell test and to obtain random bits from some func- 
tion of the measurement outcomes. In [ij, the bipartite 
scenario of chained Bell inequalities was shown to be 
useful in obtaining perfectly random bits as measurement 



outcomes for a limited range of e values (e < 



^ ^ as- 

suming correctness of quantum theory). In [ij, a more 
complicated five-party scenario using Mermin inequali- 
ties [llj was considered and shown to generate perfect 
random bits for any initial value of e < ^. The validity 
of the no-signaling principle is vital in both protocols, in 
fact no-signaling was shown to be necessary for perfect 
randomness to occur in any theory. 

A fundamental understanding of the probability dis- 
tributions of bits generated by the source of partial ran- 
domness is necessary to study how and when tasks such 
as randomness amplification can be performed given dif- 
ferent strengths of the adversary. In this paper, we in- 
vestigate the structure of the SV source showing that 
the extremal points of the set of probability distributions 
from such a source are permutations of Bernoulli distri- 
butions. Indeed, this fact has already found application 
in the task of randomness amplification given adversaries 
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limited to quantum resources [3|. Moreover, in the search 
for simpler (possibly bipartite) protocols for generation of 
perfect random bits from any initial value of e for any no- 
signaling adversary, it becomes vital to derive intuitive 
methods that apply to arbitrary scenarios as well as to 
understand the limits of applicability of currently known 
protocols We address both these issues, providing 
an analysis of the protocol of randomness amplification 
in terms of the randomness present in the no-signaling 
boxes that appear in convex decompositions of the quan- 
tum box of probabilities. This is then used for a direct 
derivation of the known range of e values from which 
perfect randomness can be generated using the bipartite 
correlations violating the chained Bell inequalities as well 
as to extend the result to asymptotically exact values. 

Structure of Santha- Vazirani sources. The protocol 
for randomness amplification from SV sources using non- 
local quantum correlations involves the use of the source 
to choose the measurement settings in the Bell expres- 
sion. For example, in the bipartite scenario of the chained 
Bell inequalities, a string of bits from the source is used 
to generate the measurement settings x and y of the two 
parties. Our aim in this section is to characterize the 
joint probability distributions P(x, y) which can arise 
from the source, i.e., those that satisfy the SV source 
conditions ([T]). We investigate the structure of the SV 
sources and prove that the distributions obeying ([!]) are 
mixtures of permuted Bernoulli distributions. Formally, 
we state the following proposition (proof provided in the 
Supplementary Material) which will be used in the anal- 
ysis of the randomness amplification protocol in subse- 
quent sections. 

Proposition 1. Extremal points of the set of prob- 
ability distributions from a Santha- Vazirani source with 
parameter e arc permutations of Bernoulli distributions 
with parameter p = where p+ = ^ + £• 

Remark. Not all permutations arc allowed. 

Randomness amplification from non-local quantum 
correlations. Consider the scenario where the bits gen- 
erated by the SV source (that are partially free with re- 
spect to any set of space-time variables held by an adver- 
sary Eve) are used to choose the measurement settings 
in a Bell test by a set of spatially separated observers. 
Upon violation of the inequality, the parties process the 
measurement outcomes in order to obtain a perfect ran- 
dom bit. The general N party Bell inequality for ran- 
domly chosen measurement settings can be written as 

(3 = J2a{a,x)Pi3\x)<h- (2) 

Here, x denotes a set {xi, . . . ,xn} of measurement set- 
tings chosen by the N parties, a = {ai, . . . ,aN} denotes 
the respective measurement outcomes, a(a, x) are a set of 
coefficients and P{d\x) denotes the conditional probabil- 
ity of outcomes a given settings x. The bound denotes 
the optimal value of the Bell parameter attainable within 



local hidden variable (LHV) theories. A quantum state 
under suitable measurement settings then generates the 
box of probabilities Bq that leads to optimal violation 
of the inequality /3q. In the scenario where the mea- 
surement settings are not chosen freely but using an SV 
source with parameter e, one obtains a new LHV optimal 
value as a function of e denoted by /3L(e). The adversary 
Eve may attempt to simulate the value /3q using a con- 
vex combination of no-signaling boxes B^^^g which pro- 
duce values /3^^5, i.e., /Sq = J^iPif^N's ^i^^ J2iPi = 1- 
The process of randomness amplification is then trans- 
parently based on the randomness present in the boxes 
^N^s- some function of the measurement outcomes 
(in particular, simply one of the measurement outcomes 
of a single party [l|) is random for all boxes -6^5 ap- 
pearing in any convex decomposition, then the parties 
may use this as the output free random bit completely 
uncorrelated from Eve. It is immediately seen that to 
perform free randomness amplification (e„e^ = 0) from 
any initial value of e < ^, one requires that the maximum 
no-signaling violation of the Bell inequality be achievable 
within quantum theory; if not. Eve may choose a finite 
fraction of deterministic boxes in the simulation. In gen- 
eral, for any given Pq one may write 

/?Q = (l-<5)/?W +^^3^^ (3) 

where /Sjj'g'* is the optimal violation of the inequality by 
boxes that do not give randomness and S is the maxi- 
mum fraction of such boxes that an adversary may use 
to successfully simulate /3q . One may recast the above in 
terms of the probability of failure to win a game defined 
by /3, where the no-signaling boxes with randomness suc- 
ceed with probability 1. Then, using rjg = (1 — /3q) to 
denote the minimum probability of failure within quan- 
tum theory to win the game and similarly r]sv to denote 
the minimum probability of failure to win the game using 
no-signaling boxes that do not yield randomness (while 
choosing the settings using the SV source), we obtain 



When (5 = 0, one obtains the randomness present in the 
no-signaling boxes. 

Randomness amplification using chain inequalities. In 
the amplification of randomness using chained Bell 
inequalities was investigated. Two results were ob- 
tained, the first under the assumption of correctness of 
quantum theory, i.e., that the observed distribution of 
measurement outcomes is as given by the theory, and the 
second without this restriction. In the former scenario, 
it was shown that for given e < , there exists a 

protocol that uses e-free bits with respect to any set of 
space-time variables W to obtain e'-free bits with respect 
to W for any < e' < e. In particular, the quantum 
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correlations between the measurement outcomes for the 
chain inequahty were used to show that the output bit 
of one party's measurement is arbitrarily close to being 
uniform and uncorrelated with W. Following the general 
considerations of the previous section, we can now for- 
mulate an intuitive and simpler derivation of this result. 

The chained Bell inequality considers the bipartite sce- 
nario of two spatially separated parties Alice and Bob 
who each choose from a set of N measurement settings: 
X e {0,...,N - 1}a for Alice and y £ {0, . . . , iV - Ijs 
for Bob. Each measurement results in a binary outcome 
a e {0, 1} for Alice and b e {0, 1} for Bob. The chained 
Bell inequality is then written as 

P(a © 6 = l|a;, y) + P(a ® 6 0|0, - 1) > 1, 

x=y\\x=y+l 

(5) 

where © denotes addition modulo 2. Notice that out of 
the A^^ possible measurement pairs, only the 2N neigh- 
boring pairs where x = yoTX = y + l (sum modulo 
A^) forming a chain are considered in the inequality and 
the LHV bound is obtained from the fact that perfect 
correlations in the outcomes for the 2A — 1 pairs in the 
sum automatically implies perfect correlation for the pair 
{0, A^ — 1}. Quantum mechanics violates this inequality 
obtaining a value of 2A^sin^(^) which for large A tends 
to the algebraic limit of 0. This optimal quantum value is 
obtained by measuring on the maximally entangled state 
I (/)_!_) = -^(lOO) -I- 1 11)) with the measurement settings 
defined by the bases {|0/c), |lfc)} (for k = x,y). Here 



\0k) 



cos^lO) 



#|1), \W 



f|0) 
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with the angles (pk = f^- The set of no-signaling boxes 



for this scenario was studied in jl2l |. a no-signaling box 
with precisely the PR-box structure of perfect correla- 
tions for the 2A^ — 1 neighboring pairs in the sum and per- 
fect anti-correlations for the remaining pair exists which 
in addition to incorporating perfect randomness attains 
the optimal no-signaling value of 0. A crucial observa- 
tion is that if one pair of measurement settings is known 
to not occur, classical theories can simulate the optimal 
no-signaling violation of the inequality. 

Ideally the measurement settings would be chosen 
freely, however in this scenario they are chosen by Alice 
and Bob each using r := log2 A^ bits from an SV source 
with non-zero e. The optimal classical strategy by an ad- 
versary is to choose the term that equals 1 in the Bell ex- 
pression corresponding to the pair of measurements that 
the SV source provides with minimum probability. One 
therefore considers the inequality 

P{x,y\w)P{a®b^ l\x,y) + 

x=y\\x=y+l 

P(0, A^ - l\w)P{a © 6 = 0|0, N-l)> p^i^ (6) 

for each w in the set of space-time variables with which 
the imperfectly free SV source may be correlated (and 



which may be thought of as held by the adversary Eve) . 
The bound Pmin = min^j^y P(a;, is the minimum 
probability of a pair of measurement settings chosen by 
Alice and Bob, ideally p'^f^^ = ^ (for e = 0). As 
in the previous section. Eve tries to simulate the value 
/3q = sin^(^) using no-signaling boxes with randomness 

(r) 

which produce /3]vs ^^'^ those which do not incorporate 
randomness and give P^^g^- Crucially, for the chained 
inequalities all the vertices of the no-signaling polytope 
have been characterized in [T^j and it is found that only 
those boxes with perfect randomness in the outcomes 



(r) 

0) violate the chain inequality giving f3)^g 



0. 



All other no-signaling boxes do not violate the inequality 
and produce p'^^g' > Pmin- Therefore, the optimal vio- 
lation of the inequality that Eve can achieve using any 
fraction 5 of non-random no-signaling boxes (and fraction 
(1 — (5) of random ones) is given by Psv = (^Pmin- 

The measurement settings are chosen using 2r uses of 
the imperfect SV source by Alice and Bob, say the first 
r bits give in binary the setting x for Alice and the next 
r bits give Bob's setting y. The minimum probability 
of occurrence for any measurement pair among the A^^ 
pairs is then p^J^ ~ (i — e)^*". From the set of obtained 
measurement settings, only those corresponding to the 
2A^ neighboring pairs in the chain inequality are retained 
while the rest are discarded. Therefore, the minimum 
probability in the sequence of 2A^ pairs, Pmin is given by 



Pn\h\ 9,v. 

p_ 



V- 



|P(x,y)||2N-i ■ 



(7) 



where ||P(x, y)||2N-i is the (2A^ — 1)*'' Ky Fan norm 
of the probability distribution P(x, y) generated by the 
source, i.e., the sum of the 2A^ — 1 largest probabilities. 
The denominator of the above expression can be bounded 
from above by 2Np'^ where p+ = (i 4- e), since p'^ is the 
largest probability of occurrence of a bit string of length 
2r generated by the source. We therefore obtain that the 
value of the Bell expression simulated by Eve is given by 



Psv = Spmin > S 



2r+lp2r 



(8) 



For consistency with the vahie obtained in quantum the- 
ory, we have P^-u < Pq, i.e., 5 ^Zip'ir- < sin^ (2^)- The 
fraction of non-random boxes 5 approaches (and per- 
fect randomness is obtained) as we increase the number 
of measurement settings A^(= 2"^) provided 



lim 



TT^ pX 

8 2'-p^_I 



giving 



< 1, thus recovering e < 



(9) 



0.086. 



Asymptotically exact bounds on randomness. Here, we 
show an improved estimate on the minimum probability 
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Pmin for obtaining a pair of measurement settings from 
the SV source which gives exact values for the range of 
allowed e in the asymptotic limit of large N. Among 
the joint probability distributions that satisfy the SV 
conditions are the extremal ones which as we have seen 
are (certain) permutations of the Bernoulli distribution. 
Our goal is to find the {2N — 1)*'' Ky Fan norm of the 
Bernoulli distribution, which being the first 2N — 1 max- 
imal probabilities is permutation invariant and therefore 
the same for all extremal distributions. 

The 2N — 1 Ky Fan norm of the Bernoulli distribution 
B satisfying SV conditions ^ is: 



\B\ 



2r 



(10) 



where m is chosen to obtain the 2''+^ — 1 largest proba- 
bilities. The task of finding m can be reformulated using 



m < min{cr : f . j > 2 



i=0 



-yr+l 



1} 



(11) 



to finding the minimum c satisfying the inequality above. 

We now state the following Lemma (with proof in 
the Supplementary Material) which provides bounds on 
||i3||2'-+i-i, and leads to the asymptotically exact range 
of e from which perfect randomness may be extracted. 

Lemma 2. The Ky Fan norm of the Bernoulli dis- 
tribution ||i3||2i-+i_i with parameter p_ = (1/2 — e) for 
large r obeys 



2r 



cr (2-c)r 
P-P+ 



< ll^lla^+i-i < k 



2r 



cr (2-c)r 



, (12) 



where c is the solution to 22'-^(=/2) = 2"^ (c w 0.22) and 

, _ (2-c)(l-2e) 
^ 2(l-c-2c) ■ 

The above Lemma is now used to find when the upper 
bound on S approaches zero, i.e., when 



hm — ^ = 

r^oo 16 22>2r- 



(13) 



The bounds in ([T^ imply that the limit is defined by the 
behavior for large r of 



/'2r\ cr (2-c)r 

Up-p+ 



(2-c)r 
y2rH{c/2) P+ 



22rJ.2-c)r ' 



(14) 



For the limit to be 0, we need {l/2 + ef~'' < 2(l/2-e)2-'= 
for c « 0.22 giving e < ^^^^Yy'i'aJ,')'^^^ « 0.0961 which is the 
asymptotically exact maximal value for e due to the up- 
per and lower bounds derived on the Ky Fan norm. In 
fact, for e larger than this critical value, free randomness 
cannot be obtained in the protocol, i.e., the newly gener- 
ated randomness value e„eto > e for this range as shown 
below. 



Note that the amount of randomness enew obtained in 
the protocol is given by (1/2) -I- Cnew = (1 — (5) x (1/2) -|- 
(5x1, i.e., tnew — 5/2, so that for finite r, 



sin^(2^) 



(15) 



-p^- + \\B\\^r+l_^ 

Using the inequality, X^IJJ (T) ^ 2^('=/2)2'- for finite r, 
we see that c > 0.22 in the definition of ||i3||2'-+i-i for 
any finite r. We may therefore lower bound enew as 



> 



sir?{^){p^I + (2'-+i 



l)p0.22rpl.78r) 



2p^l 



,2r 



(16) 



Using sinx > .t — x'^/6, we see after some algebraic ma- 
nipulation that for e > 0.0961, the lower bound above 
exceeds e meaning no amplification is possible. 

Conclusions. Randomness amplification from quan- 
tum correlations violating Bell inequalities is shown to 
be directly related to the fraction of no-signaling boxes 
incorporating randomness which appear in any possible 
convex combination of boxes simulating the violation. 
The bipartite scenario of the chained Bell inequalities 
(which includes the commonly considered CHSH inequal- 
ity) is arguably the most studied as well as being exper- 
imentally friendlier than multi-party scenarios. An intu- 
itive and simple derivation is provided for the range of 
partial randomness from which perfect randomness can 
be generated using quantum correlations violating these 
inequalities. In addition, asymptotically exact bounds 
obtained on the minimum probability of a pair of mea- 
surement settings from an SV source enable us to identify 
the most imperfect source from which perfect randomness 
can still be generated using these correlations. The char- 
acterization of the probability distributions obeying the 
SV source conditions performed here is of independent 
interest in general scenarios as well 
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Supplementary Material. Here, we present the for- 
mal proof of the proposition and lemma stated in the 
text. 

Proposition 1. Extremal points of the set of probability 
distributions from Santha- Vazirani source are permuta- 
tions of Bernoulli distributions with parameter p = p^, 
with p-|_ = i + e. 

Remark. Not all permutations are allowed. 
To prove the proposition we will need the following 
lemma. 

Lemma 1. Consider two alphabets X and Y , with \X\ = 
K^\Y\ ~ M . Consider some convex sets Sx and Sy 
of the probability distributions over the spaces X and Y 
respectively. Consider an arbitrary joint probability dis- 
tribution p{x,y). Let p{y\x) be the corresponding con- 
ditional probability distribution and p{x) the marginal 
one. Suppose now that for any fixed x, the distribution 
{p{y\x)}y belongs to Sy , and the distribution {p{x)}x be- 
longs to Sx ■ Then we can write p{x, y) as a mixture of 
probability distributions of the form 

p{x,y)=p^''\y)r{x) (17) 

where distribution p^^-* is extremal in the set Sy and dis- 
tribution r is extremal in set Sx- 

Proof. Clearly, it is enough to prove that p(x, y) can be 
written as mixture of distributions 

p'{x,y)^p{x)p^-Hy) (18) 

where p^^^ is extremal in Sy. Indeed, then we can de- 
compose p{x) into extremal points in Sx, and reach the 
form dl]). 

Let run over extremal elements of Sy. We define 
the following distributions 

p^,,...^J,{x,y)=p{x)p^'''^y) (19) 

Clearly they are of the required form (fT8|). We will now 
show that a suitable mixture of such distributions gives 
p{x, y). To see this, note that since for each x, the distri- 
bution p{y\x) belongs to Sy^ we can write it as a mixture 



of pW's 

p(2/|x)=^AfV*)(y) (20) 

i 

where 

E^^'' = l' (21) 

i 

for each x. We wih now show that 

pix,y)^ J2 \^-...-^^P.,,...^A^,y) (22) 

ii,...,iN 

which is what we need to prove, as by (|2ip we have 

E A!^....Aif = 1 (23) 

ii,...,ijv 

and Pii,..AK i^, y) a-r^ of the required form p8|) . To prove 
the equality (P^ . we write 

E A(^....Ai:W,.....(-,y) = 

ii,...,i]V 

E AW.....Ai;:V(.)p(-)(y) = 

ii,...,iiv 

E >^t^Pix)p'-"''Hy) = p{x)p{y\x) = p{x, y). (24) 

ix 

The last but one equality we obtain from the fact that 
only for index i^ the summand is nontrivial, for other 
indices the summands are just A's which sum up to 1. □ 

Now we are in position to prove the proposition [TJ 

Proof of proposition [7J To prove the proposition, we will 
apply the lemma [1] iteratively. The set X will be the set 
of n bits, while the set Y will correspond to a single bit. 
Sy then has two extremal points (p+,p_) and (p_,p+). 
Let us first illustrate the lemma for the case of X also 
being a single bit. Then simply, 

{p{x,y)} = (p(0)p(0|0),p(0)p(l|0),MlMO|l),MlMl|l)) 

(25) 

Now, for a; = 0, we have decomposition 

p(0|0) = aop+ + (l-ao)p-, p(l|0) = aop- + {l-a^)p+. 

(26) 

For a; — 1 we have some other decomposition 

p(0|l) aip+ + (l-ai)p_, p(l|l) aip_ + (l-ai)p+ 

(27) 

To catch up with notation of the lemma, we have ao = 
Aj, 1 — ao = A2, and ao = A^°\ 1 — ao = A2°\ and p*^^' = 
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= are external points from Sy- We 

can directly check that 

(p(0M0|0),p(0Mi|0),p(iM0|i),p(iMi|i)) = 

aoai{p{0)p+,p{0)p-,p{l)p+,p{l)p-) + 
ao(l - ai){p{0)p+,p{0)p-,p{l)p-,p{l)p+) + 
(1 - ao)ai{p{0)p-,p{0)p+,p{l)p+,p{l)p^) + 
(1 - ao)(l - ai){p{0)p.,p{0)p+,p{l)p.,p{l)p+) 

(28) 

Thus we have shown explicitly, decomposition of p{x, y) 
into distrbutions of the form ([TS]). Now we further de- 
compose the distribution (p(0),p(l)) into extremal points 
of Sx which are in this case the same as those of Sy- 
(p+,P-) and Therefore {p(x,yY\ is mixture of 

the eight probability distributions 



since they are its permutations. Note that not all permu- 
tations are allowed, because the above construction has 
the structure of a tree. □ 

Lemma 2. The Ky Fan norm of the Bernoulli distribu- 
tion ||i3||2'-+i-i with parameter p- = (1/2 — e) is hounded 
for large r by 



2r\ (2-c)r II nil , /2r\ (2-c)r ,„r,\ 

P^ZpX ' < ||S||2.+i_i < fc h'ZpX (32) 



where c is the solution to 2^rH{c/2) _ (H{x) denotes 

2~c)(l-2(; 
2(l-c-2c) 



binary entropy giving c « 0.22 ) and k — "^^^^ — — 



0.89(l-2£) 
2(0.i39-e) ■ 

Proof. As seen in the text, the Ky Fan norm of the 
Bernoulli distribution 



[P+P+ , P+P- iP-P+i P-P- ) 
{p+P- , P+P+ ,P-P+i P-P- ] 
{p-P+ ,P-P-, P+P+ , P+P- ] 
(p-P- , P-P+ , P+P+ , P+P- ] 



[P+P+ , P+P- , P-P- , P-P+ ) , 
{p+P- , P+P+ ,P-P-,P-P+)i 
{p-P+ ,P-P-i P+P- , P+P+ ) , 
(p-P- ,P-P+, P+P- , P+P+ ) 1 



\B\ 



m 

E 

i=0 



2r 



pT 



(33) 



can be reformulated using 



(29) 



m < min{cr : E ( ) > 2iV - 1} 



(34) 



where the ordering is as follows: 

(p(0,0),p(0,l),p(l,0),p(l,l)). 



(30) 



Note that the first distribution is precisely the Bernoulli 
distribution, with probability of in single trial being 
p = p+. This distribution is memory less. The other 
distributions are not memoryless, but are related to the 
Bernoulli distribution by permutation of probabilities 
(not bits). Note that only 8 out of 24 permutations ap- 
pear. 

For n bits, the lemma implies that the extremal prob- 
ability distributions are created from product of the ex- 
tremal distributions for n — 1 bits, as follows. For given 
extremal distribution (r(l), . . . , r(iir)) with K = 2"^^, 
we construct the following extremal point: 

(r(l)p+, r(l)p_, r(2)p+, r(2)p_, . . . , r{K)p+,r{K)pJ) . 

(31) 

The other extremal points can be generated from it by 
changing the order of p+ and p- for each x = 1, . . . ,K 
independently. This implies, that all the extremal points 
are permutations of the above one. Now, by induction we 
assume that the distribution (r(l), . . . , r{K)^ over n — 1 
bits is a permutation of Bernoulli distribution over n bits 
with parameter p ^ p+. Thus, there is permutation a 
that reorders it, so that it becomes Bernoulli. We can ap- 
ply this permutation to reorder pairs {r(i)p^, riP-) in the 
distribution (|3T|). The resulting distribution is Bernoulli 
for n bits with parameter p+ . Thus (j31|) is permutation 
of Bernoulli, and hence all other extremal points are, too. 



into finding the minimum c that satisfies the inequality 
above. Note that for c < 1 



<E 

'i=0 



< (cr + 1) 



2r 



(35) 



since (^^) is the largest term in the sum. For large r 
(and consequently large N = 2""), by the Stirling ap- 
proximation, we have that (^^) w '2?''^ti(cj2) -^^j^gj-g JH^x) 

denotes the binary entropy. Therefore, from X]i^=o (T) — 
2iV-l( 



2'') we obtain the condition 

22rH{c/2) _ 



(36) 



giving the value c ~ 0.22 which is asymptotically exact 
because of the inequalities in (pSj) . 

Note that then ||i3||2'-+i_i is trivially lower bounded by 
{^J^)p'^P+ '^''^ as these form a subset of the probabilities 
appearing in ||i3||2''+i-i- To derive the upper bound, we 
use the observation that for < i < cr. 



where the constant a 



< 



P+ 



2r — i p. 

c(l+2£) 



< a. 



(37) 



< 1 for e < 0.39. 



(2-c)(l-2£) 

Iteratively applying the inequality, for < i < cr. 



2r 



p-pI'- 



2r 



cr 



cr (2-c)r 
P-P+ ' ■ 



(38) 



Consequently, we obtain for the Ky Fan norm, which estabhshcs the upper bound. 



1=0 



< 'lr'"-^;' rV-pg-"- (39) 



2(l-c-2e) 



cr 



